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1. Introduction 

Unit nonresponse causes bias in survey estimates when the outcomes of respondents and 
nonrespondents are different. For NPSAS:2000, there were three levels of response: institution 
response defined as the institution providing an enrollment list for sampling, computer-assisted 
data entry (CADE) response, and computer-assisted telephone interview (CATI) response. A 
CATI respondent was defined as any sample member who completed at least Section A of the 
CATI interview, an abbreviated interview, or paper-copy of the interview. 

Additionally, a CADE respondent was defined as any sample member for whom the 

CADE: 

• financial aid gate question was answered, AND 

• enrollment section had some enrollment data provided, AND 

• student characteristics section had at least one valid response for the set of items: 
date-of-birth; marital status; race; and sex. If the case matched to the Department 
of Education’s Central Processing System (CPS), it was considered to have 
successfully met this criterion. 

A study respondent was defined as any sample member who was either a CATI respondent, a 
CADE respondent, or both. 

The following weighted response rates were obtained: 

• institution -91.3 percent 

• CADE - 97.1 percent 

• CATI - 71 .9 percent 

• overall (institution rate X CATI rate) — 65.6 percent. 

Because the response rates were less than 70 percent in some sectors or overall, an 
analysis was conducted to determine if CATI estimates were significantly biased due to CATI 
nonresponse. For NPSAS:2000, data were collected not only from students using CATI and 
from institutions using CADE but also from databases such as the Department of Education’s 
financial aid Central Processing System and National Student Loan Data System (NSLDS).. 
Therefore, considerable information was known for CATI nonrespondents and these data were 
used to analyze and reduce the bias. The distributions of several variables using the design- 
based, adjusted weights for study respondents (study weights) were found to be biased before 
CATI nonresponse adjustments. The CATI nonresponse and poststratification procedures, 
however, reduced the bias for these variables. When the weighting was completed, no variables 
available for most respondents and nonrespondents had significant bias for all students 
combined. The bias was significantly reduced, and the remaining bias is small. Section 2 
discusses the characterization of bias before CATI nonresponse adjustment, section 3 describes 
the weight adjustments used to reduce bias, section 4 describes the bias for CATI variables, 
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section 5 discusses the bias remaining after weight adjustments, section 6 assesses the overall 
predictive ability of the three nonresponse models, and section 7 presents conclusions. 

2. Bias Before CATI Nonresponse Adjustment 

CATI respondents and nonrespondents were characterized by comparing the weighted 1 
percentage of CATI respondents with the weighted percentage of CATI nonrespondents for each 
category of important characteristics known for both respondents and nonrespondents. T-tests 
were performed to determine if the difference between respondents and nonrespondents was 
significant at the five percent level. 

Table 1 compares demographic characteristics of CATI respondents and nonrespondents 
for all students combined and also shows the full sample distribution. This table shows that the 
distributions of many student demographic characteristics, such as age, race, ethnicity, sex, 
student type, fall enrollment status, and receipt of aid are significantly different for CATI 
respondents and nonrespondents. Some institution characteristics, such as level, control, and 
region, are also are significantly different for CATI respondents and nonrespondents. Some of 
the statistically significant differences are not large differences, but aid recipients are clearly 
more likely to be respondents. When the differences between CATI respondents and 
nonrespondents are significant, the bias is also significant, as described below. Note that many 
of the variables in this table are derived from multiple sources that could influence the results if 
additional information obtained in CATI could be the reason for a difference between 
respondents and nonrespondents. Footnotes to table 1 indicate the primary data sources. 

The nonresponse bias was estimated for variables known for both respondents and 
nonrespondents. The bias in an estimated mean based on CATI respondents, y R , is the 
difference between this mean and the target parameter, , i.e., the mean that would be estimated 
if a complete census of the target population was conducted. This bias can be expressed as 
follows: 

B {y R ) = yr-x- 

The estimated mean based on CATI nonrespondents, y NR , can be computed if data for 

the particular variable for most of the nonrespondents is available. The estimation of 7t is as 
follows: 



x = {\-v)y R +vy m 



where T| is the weighted unit nonresponse rate. Therefore, the bias can be estimated as follows: 

B{yn)=yR-* 



or equivalently 



1 The study weights and imputed data were used. 
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B(y R ) = rj(yR-y N R ) • 



This formula shows that the estimate of the nonresponse bias is the difference between the mean 
for CATI respondents and nonrespondents multiplied by the weighted nonresponse rate. The 
variance of the bias was then computed using Taylor Series estimation in RTI’s software 
package SUDAAN. 

Tables 2, 3, 4, and 5 show the nonresponse bias before and after weight adjustments for 
selected variables for all students, baccalaureate recipients, all undergraduate students, and 
graduate/first-professional students, respectively. The first set of columns in tables 2 through 5 
shows the estimated bias before CATI nonresponse adjustment and imputation for the variables 
available for most responding and nonresponding students. The respondent and nonrespondent 
counts and means do not match those in table 1 because table 1 included imputed data and tables 
2 through 5 did not include imputed data for the before CATI nonresponse adjustment estimates. 
Also, no categories for missing data were included in tables 2 through 5. A few variables have 
no before-adjustment results because they had high levels of missing data. T-tests were used to 
test each level of the variables for significance of the bias at the 0.05/(c-l) significance level, 
where c is the number of categories within the primary variable. Below and in table 6 are 
summaries of the before-adjustment significant bias across the four tables: 



• at least one level of most of the variables is biased for at least one student type 

• Pell grant amount categories are biased only for all students combined and 
Stafford loan categories are biased only for undergraduate students 

• two variables are biased for two student types; five variables are biased for three 
student types; and twelve variables are biased for all four student types 

• Pell grant amount and Stafford loan amount are not biased for any of the student 
types 

• 20 variables are biased for all students combined; 17 variables are biased for 
baccalaureate recipients, 18 variables are biased for undergraduate students, and 
14 variables are biased for graduate/first-professional students 

• significant biases are usually small and sometimes are due to small sample sizes. 

Weighting adjustments reduced bias to the extent possible as described in sections 3 and 5. 



National Postsecondary Student Aid Study 1999-2000 (NPSAS:2000) 
CATI Nonresponse Bias Analysis Report 



Table 1. — Comparison of NPSAS:2000 CATI respondents and nonrespondents for all students 





CATI respondents 


CATI nonrespondents 


Full sample 


Variable 


Sample size 


Percent 

estimate 1 


Sample size 


Percent 

estimate 1 


Sample 

size 


Percent 

estimate 1 


Age 2 














19 or younger 


6,480 


19.5 


2,560 


19.0 


9,030 


19.3 


20 to 23 


16,140 


31.2 


6,290 


32.2 


22,420 


31.5 


24 to 29 


9,380 


19.3 


4,140 


21.8* 


13,510 


20.1 


30 to 39 


6,910 


16.1 


2,540 


14.9* 


9,440 


15.8 


40 or older 


5,600 


13.9 


1,760 


12.1* 


7,360 


13.4 


Race 3 














White 


4,980 


77.7 


12,840 


74.2* 


47,820 


76.7 


Black or African American 


4,960 


12.1 


2,290 


13.5 


7,250 


12.5 


Asian 


2,540 


5.3 


1,540 


8.6* 


4,080 


6.3 


American Indian or Alaska 


280 


0.7 


180 


1.2* 


460 


0.9 


Native 














Native Hawaiian or other Pacific 


140 


0.4 


150 


1.0* 


290 


0.5 


Islander 














Multiple races 


1,600 


3.8 


280 


1.6* 


1,880 


3.2 


Ethnicity 3 














Not Hispanic 


40,010 


89.1 


14,960 


87.0* 


54,960 


88.5 


Hispanic 


4,490 


10.9 


2,320 


13.0* 


6,810 


11.5 


Sex 3 














Male 


18,230 


42.2 


7,800 


46.9* 


26,030 


43.6 


Female 


26,260 


57.8 


9,480 


53.1* 


35,740 


56.4 


Institution level 4 














4-year 


33,690 


57.9 


11,770 


51.1* 


45,460 


55.9 


2-year 


7,450 


39.8 


3,720 


46.2* 


11,170 


41.7 


Less-than-2-year 


3,360 


2.3 


1,790 


2.8 


5,140 


2.4 


Institutional control 4 














Public 


28,060 


75.9 


10,610 


77.2 


38,680 


76.3 


Private not-for-profit 


12,540 


19.6 


4,580 


17.7* 


17,110 


19.0 


Private for-profit 


3,890 


4.5 


2,090 


5.1 


5,980 


4.7 


Institutional region 4 














New England 


2,540 


5.2 


1,040 


5.4 


3,580 


5.2 


Mid East 


7,330 


15.2 


2,730 


14.3 


10,060 


14.9 


Great Lakes 


7,360 


15.8 


2,640 


14.7 


10,000 


15.5 


Plains 


3,520 


7.2 


1,150 


6.0* 


4,660 


6.9 


Southeast 


10,010 


23.0 


3,440 


19.4* 


13,450 


21.9 


Southwest 


4,650 


11.1 


2,140 


13.7* 


6,780 


11.9 


Rocky Mountain 


1,850 


3.9 


610 


3.7 


2,460 


3.9 


Far West 


6,440 


17.4 


3,080 


21.1* 


9,520 


18.5 


Outlying area 


800 


1.3 


460 


1.7 


1,260 


1.4 



See footnotes at end of table. 
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Table 1. — Comparison of NPSAS:2000 CATI respondents and nonrespondents for all students — 

Continued 





CATI respondents 


CATI nonrespondents 


Full sample 


Variable 


Sample size 


Percent 

estimate 1 


Sample size 


Percent 

estimate 1 


Sample size 


Percent 

estimate 1 


Student type 4 (sampled) 
Baccalaureate recipient 


11,340 


6.9 


3,700 


5.7* 


| 15,040 


6.5 


24,620 


78.8 


10,890 


83.3* 


35,510 


80.1 


Other undergraduate student 


7,610 


12.4 


2,400 


9.5* 


10,010 


11.6 


Graduate student 


920 


1.9 


280 


1.5* 


1,200 


1.8 


First-professional student 
Student type 3 (CADE) 


35,540 


85.2 


14,400 


88.5* 


49,930 


86.2 


Undergraduate student 


8,040 


13.0 


2,600 


10.1* 


10,640 


12.2 


Graduate student 


920 


1.8 


280 


1.4* 


1,200 


1.7 


First-professional student 
Fall enrollment status 3 


7,020 


18.2 


3,520 


22.7* 


10,540 


19.5 


Not enrolled 


27,730 


53.7 


8,990 


42.7* 


36,720 


50.5 


Full-time 


5,710 


15.8 


2,820 


18.8* 


8,530 


16.7 


Half-time 


4,040 


12.3 


1,950 


15.9* 


5,980 


13.3 


Less than half-time 
Number of phone numbers obtained 5 


150 


0.3 


860 


4.7* 


1,010 


1.6 


0 


21,080 


52.4 


7,960 


50.1* 


29,030 


51.7 


1 


13,810 


29.2 


4,770 


26.4* 


18,580 


28.4 


2 


9,460 


18.1 


3,690 


18.8 


13,150 


18.3 


3 or more 
Receipt of any aid 3 


18,240 


48.4 


8,320 


56.5* 


26,560 


50.8 


No 


26,250 


51.6 


8,950 


43.5* 


35,200 


49.3 


Yes 

Receipt of federal aid 3 


24,140 


60.4 


10,320 


66.9* 


34,460 


62.3 


No 


20,350 


39.6 


6,960 


33.1* 


27,300 


37.7 


Yes 

Receipt of state aid 3 


37,920 


85.2 


15,230 


87.8* 


53,140 


85.9 


No 


6,580 


14.8 


2,050 


12.2* 


8,630 


14.1 


Yes 

Receipt of institution aid 3 


34,040 


82.8 


14,070 


86.8* 


48,110 


84.0 


No 


10,450 


17.2 


3,210 


13.2* 


13,660 


16.0 


Yes 

Applied for federal aid 6 
No 


21,000 


51.9 


9,270 


59.1* 


30,270 


54.0 


Yes 


23,500 


48.2 


8,010 


40.9* 


31,500 


46.0 



See footnotes at end of table. 
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Table 1. — Comparison of NPSAS:2000 CATI respondents and nonrespondents for all students — 
Continued 





CATI respondents 


CATI nonrespondents 


Full sample 


Variable 


Sample size 


Percent 

estimate 1 


Sample size 


Percent 

estimate 1 


Sample 

size 


Percent 

estimate 1 


Receipt of Pell grant 7 














No 


34,760 


79.9 


13,460 


81.7* 


48,220 


80.4 


Yes 


9,730 


20.1 


3,820 


18.3* 


13,550 


19.6 


Pell grant amount received 7 














Less than or equal to $ 1 , 1 83 


2,480 


29.5 


910 


28.9 


3,390 


29.3 


$1,184 to $1,953 


2,400 


23.2 


1,020 


24.5 


3,420 


23.6 


Greater than $1,953 


4,860 


47.3 


1,880 


46.6 


6,740 


47.1 


Receipt of Stafford loan 7 














No 


28,310 


70.5 


12,050 


76.3* 


40,360 


72.2 


Yes 


16,180 


29.5 


5,230 


23.7* 


21,410 


27.8 


Stafford loan amount received 7 
Undergraduate students 














Less than or equal to $2,625 


3,710 


32.7 


1,340 


33.1 


5,060 


32.8 


$2,626 to $4,425 


3,000 


22.4 


1,020 


23.2 


4,020 


22.6 


$4,426 to $5,500 


3,860 


22.2 


1,080 


20.0* 


4,940 


21.7 


Greater than $5,500 


3,080 


22.8 


1,060 


23.7 


4,140 


23.0 


Graduate/ first-professional 
students 














Less than or equal to $8,000 


640 


23.4 


190 


23.4 


830 


23.4 


$8,001 to $12,521 


620 


23.3 


180 


23.7 


800 


23.4 


$12,522 to $18,500 


950 


39.9 


260 


37.5 


1,210 


39.4 


Greater than $18,500 


320 


13.4 


110 


15.5 


430 


13.9 



‘Using the final study weights and imputed data. 

2 Primary data sources are CADE and CPS. 

3 Primary data source is CADE. 

4 Primary data source is sampling frame. 

5 Primary data source is CATI control system. The CATI respondents with “zero phone numbers obtained” had called-in to the telephone 
center to complete the interview, or completed a self-administered paper version. 

6 Primary data source is CPS. 

7 Primary data source is NSLDS. 

*Difference between CATI respondents and nonrespondents is significant at the 0.05/(c-l) level, where c is the number of categories 
within the primary variable. 

NOTE: Some percentages may not sum to 100 percent for a variable due to rounding. To protect confidentiality of the data some numbers 
have been rounded. 

SOURCE: U.S. Department of Education, National Center for Education Statistics, National Postsecondary Student Aid Study, 1999— 
2000 (NPSAS:2000). 
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Table 2. — Nonresponse bias before CATI nonresponse adjustment and after weight adjustments for selected variables for all students 



Estimated bias 


0.0319 

0.0650 

-0.1470 

0.0260 

-0.1820 

0.2370 

0.0060 

-0.0060 

-0.0740 

-0.0560 

-0.0290 

0.1590 

-0.4720 1 

0.0050 

-0.2740 

0.7410* 

0.0860 

-0.0120 

-0.0740 

0.0560 

-0.0560 

1.51 70* 1 
-1.5170* 


Mean, study 
weights 


27.2 

19.3 
31.5 
20.1 

15.8 

13.4 

49.3 

50.8 

50.5 

16.7 

13.3 

19.5 

37.4 

16.5 
21.3 

24.8 

92.1 
4.6 
3.3 

46.0 

54.0 

42.8 

57.2 


Mean, CATI 
weights 


27.3 

19.4 

31.3 
20.1 

15.6 

13.6 

49.3 

50.8 

50.4 

16.6 
13.3 

19.7 

36.9 
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Table 5 . — Nonresponse bias before CATI nonresponse adjustment and after weight adjustments for selected variables for graduate/first 
professional students 
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Table 5 . — Nonresponse bias before CATI nonresponse adjustment and after weight adjustments for selected variables for graduate/first- 
professional students — Continued ' 
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See footnotes at end of table. 
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National Postsecondary Student Aid Study 1999-2000 (NPSAS:2000) 
CATI Nonresponse Bias Analysis Report 



Table 6. — Summary of significant nonresponse bias before CATI nonresponse adjustment by 



student type 



Description 


AH students 


Baccalaureate 

recipients 


Undergraduate 

students 


Graduate/first- 

professional 

students 


Student’s age 


T 


T 




T 


Student age groups 


T 


T 


T 


T 


Has student received any type of aid? 


T 


T 


T 


T 


Did student attend institution in the fall? 


T 


T 


T 


T 


Citizenship status 


T 


T 


T 


T 


CPS match 


T 


T 


T 


T 


Enrollment total at the student’s 


T 


T 


T 


T 


institution 










Enrollment categories 2 


T 


T 


T 


T 


Was the student enrolled in institution in 


T 


T 


T 


T 


the fall? 










Did the student receive any federal 


T 


T 


T 


T 


financial aid? 










Student’s sex 


T 


T 


T 




Did the student receive any institution 


T 


T 


T 




financial aid? 










Institution region 


T 


T 


T 


T 


Did the student receive any Pell grants? 


T 




T 


t 


Pell categories for all Pell recipients 


T 






t 


What was the amount of the Pell grant 








t 


received? 










Institution sector 


T 


T 


T 


T 


Stafford categories for Stafford recipients 3 






T 




Amount of Stafford loan received 










Did the student receive a Stafford loan? 


T 


T 


T 


T 


Did the student receive any state financial 


T 


T 


T 




aid? 










Student type - sampled 


T 


t 


T 


T 


Student type - CADE 


T 


T 


t 





T denotes significance at the 0.05/(c-l) level for at least one category of the primary variable, where c is the number of categories 
within the primary variable. 



t Not applicable 

SOURCE: U.S. Department of Education, National Center for Education Statistics, National Postsecondary Student Aid Study, 
1999-2000 (NPSAS:2000). 
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3. Weight Adjustments 

Weight adjustments are typically used to reduce bias due to unit nonresponse, and the results 
in tables 1, 2, 3, 4, and 5 show that these adjustments are important for reducing the potential for 
nonresponse bias due to the differences between CATI respondents and nonrespondents. After 
computing study weights for study respondents by making various adjustments to the design-based 
weights, adjustments were made for CATI nonresponse. In the initial nonresponse models all 
variables were incorporated that were thought to be predictive of CATI nonresponse and were 
missing for five percent or less of all study respondents including: 

• age (categorical), 

• any aid receipt indicator, 

• fall attendance status, 

• citizenship, 

• CPS record indicator, 

• institution enrollment from IPEDS IC file (categorical), 

• fall enrollment status, 

• federal aid receipt indicator, 

• sex, 

• Hispanic indicator, 

• institutional aid receipt indicator, 

• OBE region, 

• student date of birth preloaded into CATI, 

• parent data preloaded into CATI, 

• total number of phone numbers obtained for student, 

• Social Security number indicator, 

• Pell grant status, 

• Pell grant amount (categorical), 

• Stafford loan status, 

• Stafford loan amount (categorical), 

• institution type, 

• state aid receipt indicator, 

• number of institutions attended in 1999-2000, and 

• student type. 

Other variables that were considered but excluded from the “not located” model because they were 
missing for more than five percent of all study respondents were: 

• dependents indicator, dependency status, number of dependents, 

• full-year attendance status, 

• high school degree indicator and type, 

• high school graduation year, 

• local residence, 

• parents’ income, parents’ family size, parent’s marital status, 

• student’s marital status 
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• student’s income, and 

• race. 

Table 7 lists the predictor variables used for each of the three final nonresponse adjustment models. 
Dependency status and student’s marital status were included in the final other nonresponse models 
(see discussion below of the three models). Marital status was also included in the final refusal 
model. 



Also, a Chi-squared automatic interaction detector (CHAID) analysis was performed on the 
candidate predictor variables to determine important interactions. The CHAID analysis divided the 
data into segments that differed with respect to the response variable: not located, refusal, or other 
nonresponse. The segmentation process first divided the sample into groups based on categories of 
the most significant predictor of response. It then split each of these groups into smaller subgroups 
based on other predictor variables. It also merged categories of a variable that were found 
insignificant. This splitting and merging process continued until no more statistically significant 
predictors were found (or until some other stopping rule was met). The interactions from the final 
CHAID segments were then defined. 

The resulting segment interactions and all the main effect variables were then subjected to 
variable screening in the logistic procedure. Variables significant at the 15 percent significance 
level were retained, with the exception of institution type, student type, Pell grant status, and 
Stafford loan status, which were retained whether or not they were significant. It was determined 
that Pell grant status and Stafford loan status are important predictors of federal aid receipt, so these 
variables were retained in all nonresponse models to preserve the population totals of these 
predictor variables. Additionally, institution type and student type were retained in all nonresponse 
models because of their importance as stratification variables. 

The adjustment for CATI nonresponse was performed in three stages because the predictors 
of response propensity were potentially different at each stage: 

(1) inability to locate the student 

(2) refusal to be interviewed 

(3) other non-interview 

Using these three stages of nonresponse adjustment achieved greater reduction in nonresponse bias 
to the extent that different variables were significant predictors of response propensity at each stage. 
Six of the variables are only in one model as main effects, seven variables are in two models as 
main effects, and eight variables, including the four variables forced into all models, are in all three 
models as main effects. Additionally, some variables were included as a main effect in one model 
and as part of an interaction in another model. For example, ethnicity is a main effect in the refusal 
model but part of interactions in the other two models, as shown in table 7. 
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Table 7. — Variables used in final NPSAS:2000 CAT! nonresponse models 



Variable sector 


Not located model 


Refusal model 


Other nonresponse model 


Institutional sector 


X 


X 


X 


Region 


X 


X 


X 


Student type 


X 


X 


X 


Age group 


X 


X 




Sex 


X 


X 


X 


Institutional aid recipient 


X 




X 


Federal aid recipient 




X 




Pell grant recipient 


X 


X 


X 


Stafford loan recipient 


X 


X 


X 


Citizenship 


X 


X 




Ethnicity 




X 




Fall enrollment 


X 






Fall attendance 






X 


Enrollment 




X 


X 


Number of phone numbers 


X 




X 


Number of schools attended 


X 


X 


X 


Date of birth preloaded in CATI 


X 


X 


X 


CPS match 




X 




Parent information preloaded in CATI 


X 




X 


Marital status 




X 


X 


Dependency 






X 


2 CHAID segments based on ethnicity, 


X 






institutional aid receipt, and number of 








schools attended 








10 CHAID segments based on aid receipt, 




X 




number of schools attended, fall 








attendance, region, enrollment, and age 








group 








1 1 CHAID segments based on citizenship. 






X 


number of schools attended, ethnicity, 








federal aid receipt, institutional sector, fall 








attendance, marital status, and fall 








enrollment 









NOTE: The variables institution sector, student type, receipt of Pell grant, and receipt of Stafford loan were forced into 
all three models. 



SOURCE: U.S. Department of Education, National Center for Education Statistics, National Postsecondary Student Aid Study, 
1999-2000 (NPSAS:2000). 

Poststratification to control totals was used to adjust for the potential for bias resulting from 
frame errors. The CATI weights were adjusted to control totals using a generalized raking 
procedure. The control totals established during the poststratification of the study weights also were 
used for the CATI weights. These control totals were for annual student enrollment, by institution 
type; total number of Pell grants awarded; amount of Pell grants awarded, by institution type; and 
amount of Stafford loans awarded, by institution type. To help reduce nonresponse bias further, 
additional control totals were formed for annual enrollment by student type as well as control totals 
by: 
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• sex, 

• age group (less-than-24, 24-29, and 30+), 

• federal aid applicant, 

• federal aid receipt, 

• state aid receipt, 

• institution aid receipt, and 

• fall attendance status. 

The annual enrollment control totals by student type were obtained from the study weights so that 
estimates of the annual enrollment using the study or CATI weights would be the same. The other 
seven control totals listed above were also computed using the study weights because these 
variables were known for most CATI respondents and nonrespondents. 

All nonresponse adjustment and poststratification models were fit using RTI’s proprietary 
generalized exponential models (GEMs) 2 , which are logistic models incorporating bounds on the 
adjustment factors. Section 6.1 of the NPSAS methodology report describes the weighting 
procedure in more detail. 

4. Bias for CATI Variables 

The before-CATI nonresponse adjustment bias was also estimated for several CATI 
variables that were missing for CATI nonrespondents but known for more than 90 percent of CATI 
respondents. For the CATI respondents, it was assumed that the respondents who initially refused 
to be interviewed had characteristics similar to CATI refusals, and that the respondents who were 
difficult to contact, based on the number of phone call attempts, had characteristics similar to 
students who were never located. Table 8 shows the estimated bias before adjustment under these 
assumptions. 

The bias due to refusals was estimated as the difference between the mean for CATI 
respondents who were initial refusals and the mean for all other respondents, using the CATI 
weight. T-tests were used to test each level of the variables for significance of the bias at the 
0.05/(c-l) significance level, where c is the number of categories within the primary variable. Chi- 
squared tests were used to test if the distribution based on the CATI weights was significantly 
different at the 0.05 level from the distribution based on the study weights. To conduct these 
statistical tests, the study and CATI respondents were combined and the study respondents based on 
study weights were contrasted with the CATI respondents based on CATI weights. Then, 
SUDAAN was used to compute the variance and to test for significant differences. SUDAAN 
computed the variance using institution strata and PSUs and took account of the correlation in the 
estimates caused by having students on both sides of the contrast. 



2 Folsom, R.E. and A.C. Singh (2000). “The Generalized Exponential Model for Sampling Weight Calibration for 
Extreme Values, Nonresponse, and Poststratification.” Proceedings of the Section on Survey Research Methods of the 
American Statistical Association, pp. 598-603. 
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Table 8. — Nonresponse bias for CATI variables for all students 
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* Bias is significant at the 0.05/(c-l) level, where c is the number of categories within the primary variable. 

'The distribution based on the CATI weights is significantly different at the 0.05 level from the distribution based on the study weights. 

SOURCE: U.S. Department of Education, National Center for Education Statistics, National Postsecondary Student Aid Study, 1999-2000 (NPSAS:2000). 
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The bias due to inability to contact the student was estimated as the difference between the mean 
for CATI respondents who were difficult to contact and the mean for all other respondents, using 
the CATI weight. Again, t-tests were performed to test the significance of the bias for each level 
of the variables, and Chi-Squared tests were performed to test the significance of the 
distributions of each variable. 

The bias was generally higher when comparing difficult-to-locate students to the other 
respondents than when comparing the initial refusals to the other respondents. These bias 
estimates indicate that using the three nonresponse models was the proper approach because 
initial refusals differ from other respondents and difficult-to-locate students also differ from 
other respondents. 

5. Bias After Weight Adjustments 

Although tables 2 through 5 show that some bias remains after all weight adjustments for 
several variables, the magnitude of the residual bias shown in these tables is usually very small. 
The second set of columns in tables 2 through 5 shows the estimated bias after weight 
adjustments for the variables available for most responding and nonresponding students. The 
bias after weight adjustments is the difference between the means based on the CATI weights 
and the study weights. For all students combined, Pell grant receipt, Pell grant amount, 
institution sector, and student type - CADE have zero bias after weight adjustments because all 
students combined were controlled to known totals. 

For baccalaureate recipients and graduate/first-professional students, some sectors had no 
students and therefore no bias. For undergraduate students, some sectors that were all or mostly 
comprised of undergraduate students had zero bias because all students combined were 
controlled to totals for sectors. For graduate/first-professional students, student type - CADE 
had zero bias because all students combined were controlled to graduate and first-professional 
student totals. 

Figures 1 through 4 compare the estimated relative bias before CATI nonresponse 
adjustments with the estimated relative bias after weight adjustments. All four figures indicate 
that when the relative bias was large before CATI nonresponse adjustment, it was almost always 
reduced dramatically after weight adjustments. When the relative bias was small before CATI 
nonresponse adjustment, it stayed small after weight adjustments with occasional small 
increases. These figures clearly show that the CATI weight adjustments significantly reduced 
bias for all students combined, baccalaureate recipients, undergraduate students, and 
graduate/first-professional students. 

The exceptions when the bias was large before CATI nonresponse adjustment and 
remained large after weight adjustments were due to small sample sizes. For example, in 
figure 3, the outlier is for undergraduate students sampled as graduate students, and in figure 4, 
the outliers are for graduate students in less-than-4-year institution sectors. 
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National Postsecondary Student Aid Study 1999-2000 (NPSAS:2000) 
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The absolute bias decreased after weight adjustments for many variables. For various 
student groups, the percentage of variable categories that did not increase after weight 
adjustments were: 

• all students combined - 94.7 percent 

• baccalaureate recipients - 79.4 percent 

• undergraduate students - 89.9 percent 

• graduate/first-professional students - 65.2 percent. 

For all students combined, some of the Pell grant and Stafford loan amount categories had 
increased bias after weight adjustments. The estimated bias is not significant for these 
categories, and this increase occurred because Pell grant and Stafford loan amounts were 
poststratified to known program totals by sector (different categories than shown in the table). 

For baccalaureate recipients, undergraduate students, and graduate/first-professional students, the 
reasons for this increase were poststratification to totals for some of these variables, some sample 
sizes are small for some student types, and the weighting was done at the all-student level and 
not separately by student type. 

Similarly to the CATI variable bias, t-tests were performed to test the significance of the 
bias for each level of the variables, and Chi-Squared tests were performed to test the significance 
of the distributions of each variable. Below and in table 9 are summaries of the after-weighting 
bias across the four tables: 

• for all students combined, six variables had significant t-tests and five variables 
had significant Chi-Squared tests 

• for baccalaureate recipients, nine variables had significant t-tests and five 
variables had significant Chi-Squared tests 

• for undergraduate students, five variables had significant t-tests and five variables 
had significant Chi-Squared tests 

• for graduate/first-professional students, 12 variables had significant t-tests and 8 
variables had significant Chi-Squared tests 

• the variables attendance status and dependency status (two-levels and three- 
levels) had significant t-tests and Chi-Squared tests for all four student types 

• student’s marital status had significant t-tests for all four student types and 
significant Chi-squared tests for three of the student types 

• significant biases are usually small and sometimes are due to small sample sizes. 

There is not sufficient reported data available for the variables that are significantly 
biased for all students combined to eliminate the bias altogether. That is, there is too much 
missing data for these variables to be included as poststratification control totals. Other variables 
show significant bias when analyzed separately for baccalaureate recipients, undergraduate 
students, and graduate/first-professional students, but not for all students combined. 

Bias remaining after weight adjustments for variables based exclusively (or primarily) 
upon CATI data cannot be estimated because there is no data on these variables for CATI 
nonrespondents. This analysis focused on the bias due to CATI nonresponse. 
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Figure 1. — Nonresponse bias before CATI nonresponse adjustment and after weight 
adjustments for selected variables for all students 



Estimated relative 
bias after weight 
adjustments 




0 0.05 0.1 0.15 0.2 0.25 0.3 0.35 



Estimated relative bias before CATI nonresponse adjustment 



SOURCE: U.S. Department of Education, National Center for Education Statistics, National Postsecondary Student Aid Study, 
1999-2000 (NPSAS:2000). 
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Figure 2. — Nonresponse bias before CATI nonresponse adjustment and after weight 
adjustments for selected variables for students sampled as baccalaureate 
recipients 




0 0.05 0.1 0.15 0.2 0.25 0.3 0.35 



Estimated relative bias before CATI nonresponse adjustment 



SOURCE: U.S. Department of Education, National Center for Education Statistics, National Postsecondary Student Aid Study, 
1999-2000 (NPSAS:2000). 
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National Postsecondary Student Aid Study 1999-2000 (NPSAS:2000) 
CATI Nonresponse Bias Analysis Report 



Figure 3. — Nonresponse bias before CATI nonresponse adjustment and after weight 
adjustments for selected variables for undergraduate students 




Outlier due to small sample size. 

SOURCE: U.S. Department of Education, National Center for Education Statistics, National Postsecondary Student Aid Study, 
1999-2000 (NPSAS:2000). 
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National Postsecondary Student Aid Study 199&-2000 (NPSAS:2000) 
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Figure 4. — Nonresponse bias before CATI nonresponse adjustment and after weight 
adjustments for selected variables for graduate/first professional students 




Outliers due to small sample size. 

SOURCE: U.S. Department of Education, National Center for Education Statistics, National Postsecondary Student Aid Study, 
1999-2000 (NPSAS:2000). 
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National Postsecondary Student Aid Study 1999-2000 (NPSAS:2000) 
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Table 9. — Summary of significant nonresponse bias after weight adjustments by student 



type 



Description 


All students 


Baccalaureate 

recipients 


Undergraduate 

students 


Graduate/first- 

professional 

students 


Student’s age 




T 






Student age groups 




TC 




T 


Has student received any type of 








TC 


aid? 










Did student attend institution in the 










fall? 










Attendance 


TC 


TC 


TC 


TC 


Citizenship status 




TC 




TC 


CPS match 










Dependency status - two-level 


TC 


TC 


TC 


TC 


Dependency status - three-level 


TC 


TC 


TC 


TC 


Enrollment total at the student’s 










institution 










Enrollment categories 2 








T 


Was the student enrolled in 










institution in the fall? 










Did the student receive any federal 










financial aid? 










Student’s sex 










Did the student receive any 








TC 


institution financial aid? 










Institution region 


T 








Did the student receive any Pell 








t 


grants? 










Pell categories for all Pell 








t 


recipients 










What was the amount of the Pell 








t 


grant received? 










Institution sector 




T 




TC 


Student’s marital status 


TC 


T 


TC 


TC 


Stafford categories for all Stafford 










recipients 3 










Amount of Stafford Loan received 








T 


Did the student receive a Stafford 










loan? 










Did the student receive any state 










financial aid? 










Student type - sampled 


TC 


t 


TC 


T 


Student type - CADE 




T 


t 





T denotes significance at the 0.05/(c-l) level for at least one category of the primary variable, where c is the number of categories 
within the primary variable. 



C denotes significant difference at the 0.05 level between the distribution based on the CATI weights and the distribution based 
on the study weights. 

f Not applicable 

SOURCE: U.S. Department of Education, National Center for Education Statistics, National Postsecondary Student Aid Study, 
1 999-2000 (NPSAS:2000). 
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6. ROC Curve 

As described above, three nonresponse adjustment models were used. In order to assess 
the overall predictive ability of the combined models, a Receiver Operating Characteristics 
(ROC) curve was used. As shown in figure 1, the area under the ROC curve developed for the 
overall predicted response propensity was about 0.66 which corresponds to a highly significant 
Wilcoxon test statistic. 3 The curve indicates that in about two of every three randomly chosen 
pairs of sample students, one responding and the other nonresponding, the predicted overall 
response propensity of the respondent will be greater than that of the nonrespondent. This level 
of discrimination implies that the variables used in the three models are highly informative but 
not definitive predictors of a sample student’s overall response propensity. 



Figure 5. — ROC curve for overall response propensity 




SOURCE: U.S. Department of Education, National Center for Education Statistics, National Postsecondary Student Aid Study, 
1999-2000 (NPSAS:2000). 

7. Conclusions 

Information from multiple sources was used in weighting the data to reduce CATI 
nonresponse bias. Examination of variables known for most respondents and nonrespondents 
before CATI nonresponse adjustment revealed that some bias existed. In the initial nonresponse 
models all variables were incorporated that were thought to be predictive of CATI nonresponse 



3 Hanley, J.A. and B.J. McNeil (1982). “The meaning and use of the area under a receiver-operating characteristic 
(ROC) curve. Diagnostic Radiology, 143:29-36. 
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and were missing for five percent or less of all study respondents. Important interactions among 
these variables were also included in the initial models. Three nonresponse models were used to 
reduce bias. Comparing CATI respondents who were initial refusals with other respondents and 
comparing CATI respondents who were difficult to contact with other respondents also indicates 
that three models would help reduce bias. Using these three stages of nonresponse adjustment 
achieved greater reduction in nonresponse bias to the extent that different variables were 
significant predictors of response propensity at each stage. For poststratifying the CATI weights, 
control totals were used that were also used for poststratifying the study weights, and seven 
additional control totals were computed using the study weights for seven variables known for 
most respondents and nonrespondents. 

The relative bias decreased considerably after weight adjustments— especially when it was 
large before CATI nonresponse adjustment. And the relative bias remained small after weight 
adjustments when it was small before CATI nonresponse adjustment. As shown in figures 1 
through 4, CATI nonresponse bias was reduced using weighting techniques, and the remaining 
relative bias ranged from 0 to 0.35 percent. 
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Steven Kaufman 
Stephen Broughman 

Stephen Broughman 
Steven Kaufman 
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No. Title 

2000-04 Selected Papers on Education Surveys: Papers Presented at the 1998 and 1999 ASA and 
1999 AAPOR Meetings 

2000-15 Feasibility Report: School-Level Finance Pretest, Private School Questionnaire 
Recent College Graduates (RCG) 

98-1 5 Development of a Prototype System for Accessing Linked NCES Data 



Schools and Staffing Survey (SASS) 

94-01 Schools and Staffing Survey (SASS) Papers Presented at Meetings of the American 
Statistical Association 

94-02 Generalized Variance Estimate for Schools and Staffing Survey (SASS) 

94-03 1991 Schools and Staffing Survey (SASS) Reinterview Response Variance Report 

94-04 The Accuracy of Teachers’ Self-reports on their Postsecondary Education: Teacher 

Transcript Study, Schools and Staffing Survey 

94- 06 Six Papers on Teachers from the 1990-91 Schools and Staffing Survey and Other Related 

Surveys 

95- 01 Schools and Staffing Survey: 1994 Papers Presented at the 1994 Meeting of the American 

Statistical Association 

95-02 QED Estimates of the 1990-91 Schools and Staffing Survey : Deriving and Comparing 
QED School Estimates with CCD Estimates 

95-03 Schools and Staffing Survey: 1990-91 SASS Cross-Questionnaire Analysis 

95-08 CCD Adjustment to the 1990-91 SASS: A Comparison of Estimates 

95-09 The Results of the 1993 Teacher List Validation Study (TLVS) 

95-10 The Results of the 1991-92 Teacher Follow-up Survey (TFS) Reinterview and Extensive 

Reconciliation 

95-1 1 Measuring Instruction, Curriculum Content, and Instructional Resources: The Status of 
Recent Work 

95-12 Rural Education Data User’s Guide 

95-14 Empirical Evaluation of Social, Psychological, & Educational Construct Variables Used 
in NCES Surveys 

95-15 Classroom Instructional Processes: A Review of Existing Measurement Approaches and 
Their Applicability for the Teacher Follow-up Survey 
95-16 Intersurvey Consistency in NCES Private School Surveys 

95- 1 8 An Agenda for Research on Teachers and Schools: Revisiting NCES’ Schools and 

Staffing Survey 

96- 01 Methodological Issues in the Study of Teachers’ Careers: Critical Features of a Truly 

Longitudinal Study 

96-02 Schools and Staffing Survey (SASS): 1995 Selected papers presented at the 1995 Meeting 
of the American Statistical Association 

96-05 Cognitive Research on the Teacher Listing Form for the Schools and Staffing Survey 

96-06 The Schools and Staffing Survey (SASS) for 1998-99: Design Recommendations to 
Inform Broad Education Policy 

96-07 Should SASS Measure Instructional Processes and Teacher Effectiveness? 

96-09 Making Data Relevant for Policy Discussions: Redesigning the School Administrator 

Questionnaire for the 1998-99 SASS 

96-10 1998-99 Schools and Staffing Survey: Issues Related to Survey Depth 

96-1 1 Towards an Organizational Database on America’s Schools: A Proposal for the Future of 
SASS, with comments on School Reform, Governance, and Finance 
96-12 Predictors of Retention, Transfer, and Attrition of Special and General Education 
Teachers: Data from the 1989 Teacher Followup Survey 
96-1 5 Nested Structures: District-Level Data in the Schools and Staffing Survey 
96-23 Linking Student Data to SASS: Why, When, How 
96-24 National Assessments of Teacher Quality 

96-25 Measures of Inservice Professional Development: Suggested Items for the 1998-1999 
Schools and Staffing Survey 

96- 28 Student Learning, Teaching Quality, and Professional Development: Theoretical 

Linkages, Current Measurement, and Recommendations for Future Data Collection 

97- 01 Selected Papers on Education Surveys: Papers Presented at the 1996 Meeting of the 

American Statistical Association 

97-07 The Determinants of Per-Pupil Expenditures in Private Elementary and Secondary 
Schools: An Exploratory Analysis 
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NCES contact 

Dan Kasprzyk 

Stephen Broughman 



Steven Kaufman 



Dan Kasprzyk 

Dan Kasprzyk 
Dan Kasprzyk 
Dan Kasprzyk 

Dan Kasprzyk 

Dan Kasprzyk 

Dan Kasprzyk 

Dan Kasprzyk 
Dan Kasprzyk 
Dan Kasprzyk 
Dan Kasprzyk 

Sharon Bobbitt & 
John Ralph 
Samuel Peng 
Samuel Peng 

Sharon Bobbitt 

Steven Kaufman 
Dan Kasprzyk 

Dan Kasprzyk 

Dan Kasprzyk 

Dan Kasprzyk 
Dan Kasprzyk 

Dan Kasprzyk 
Dan Kasprzyk 

Dan Kasprzyk 
Dan Kasprzyk 

Dan Kasprzyk 

Dan Kasprzyk 
Dan Kasprzyk 
Dan Kasprzyk 
Dan Kasprzyk 

Mary Rollefson 

Dan Kasprzyk 

Stephen Broughman 



No. 

97-09 

97-10 

97-11 

97-12 

97-14 

97-18 

97-22 

97-23 

97 — 4 1 

97 — 42 
97^14 

98- 01 
98-02 
98-04 
98-05 

98-08 

98-12 

98-13 

98-14 

98-15 

98-16 

1999-02 

1999-04 

1999-07 

1999-08 

1999-10 

1999-12 

1999-13 

1999-14 

1999- 17 

2000- 04 

2000-10 

2000-13 

2000-18 



Title 

Status of Data on Crime and Violence in Schools: Final Report 

Report of Cognitive Research on the Public and Private School Teacher Questionnaires 
for the Schools and Staffing Survey 1993-94 School Year 
International Comparisons of Inservice Professional Development 
Measuring School Reform: Recommendations for Future SASS Data Collection 
Optimal Choice of Periodicities for the Schools and Staffing Survey: Modeling and 
Analysis 

Improving the Mail Return Rates of SASS Surveys: A Review of the Literature 
Collection of Private School Finance Data: Development of a Questionnaire 
Further Cognitive Research on the Schools and Staffing Survey (SASS) Teacher Listing 
Form 

Selected Papers on the Schools and Staffing Survey: Papers Presented at the 1997 Meeting 
of the American Statistical Association 

Improving the Measurement of Staffing Resources at the School Level: The Development 
of Recommendations for NCES for the Schools and Staffing Survey (SASS) 
Development of a SASS 1993-94 School-Level Student Achievement Subfile: Using 
State Assessments and State NAEP, Feasibility Study 
Collection of Public School Expenditure Data: Development of a Questionnaire 
Response Variance in the 1993-94 Schools and Staffing Survey: A Reinterview Report 
Geographic Variations in Public Schools’ Costs 

SASS Documentation: 1993-94 SASS Student Sampling Problems; Solutions for 

Determining the Numerators for the SASS Private School (3B) Second-Stage Factors 
The Redesign of the Schools and Staffing Survey for 1999-2000: A Position Paper 
A Bootstrap Variance Estimator for Systematic PPS Sampling 
Response Variance in the 1994-95 Teacher Follow-up Survey 
Variance Estimation of Imputed Survey Data 

Development of a Prototype System for Accessing Linked NCES Data 
A Feasibility Study of Longitudinal Design for Schools and Staffing Survey 
Tracking Secondary Use of the Schools and Staffing Survey Data: Preliminary Results 
Measuring Teacher Qualifications 

Collection of Resource and Expenditure Data on the Schools and Staffing Survey 
Measuring Classroom Instructional Processes: Using Survey and Case Study Fieldtest 
Results to Improve Item Construction 
What Users Say About Schools and Staffing Survey Publications 
1993-94 Schools and Staffing Survey: Data File User’s Manual, Volume 111: Public-Use 
Code book 

1993- 94 Schools and Staffing Survey: Data File User’s Manual, Volume IV: Bureau of 
Indian Affairs (BIA) Restricted-Use Codebook 

1994- 95 Teacher Followup Survey: Data File User’s Manual, Restricted-Use Codebook 
Secondary Use of the Schools and Staffing Survey Data 

Selected Papers on Education Surveys: Papers Presented at the 1998 and 1999 ASA and 
1999 AAPOR Meetings 

A Research Agenda for the 1 999-2000 Schools and Staffing Survey 
Non-professional Staff in the Schools and Staffing Survey (SASS) and Common Core of 
Data (CCD) 

Feasibility Report: School-Level Finance Pretest, Public School District Questionnaire 



NCES contact 

Lee Hoffman 
Dan Kasprzyk 

Dan Kasprzyk 
Mary Rollefson 
Steven Kaufman 

Steven Kaufman 
Stephen Broughman 
Dan Kasprzyk 

Steve Kaufman 

Mary Rollefson 

Michael Ross 

Stephen Broughman 
Steven Kaufman 
William J. Fowler, Jr. 
Steven Kaufman 

Dan Kasprzyk 
Steven Kaufman 
Steven Kaufman 
Steven Kaufman 
Steven Kaufman 
Stephen Broughman 
Dan Kasprzyk 
Dan Kasprzyk 
Stephen Broughman 
Dan Kasprzyk 

Dan Kasprzyk 
Kerry Gruber 

Kerry Gruber 

Kerry Gruber 
Susan Wiley 
Dan Kasprzyk 

Dan Kasprzyk 
Kerry Gruber 

Stephen Broughman 



Third International Mathematics and Science Study (TIMSS) 

2001-01 Cross-National Variation in Educational Preparation for Adulthood: From Early 
Adolescence to Young Adulthood 

2001-05 Using TIMSS to Analyze Correlates of Performance Variation in Mathematics 

2001- 07 A Comparison of the National Assessment of Educational Progress (NAEP), the Third 

International Mathematics and Science Study Repeat (TIMSS-R), and the Programme 
for International Student Assessment (PISA) 

2002- 01 Legal and Ethical Issues in the Use of Video in Education Research 



Elvira Hausken 

Patrick Gonzales 
Arnold Goldstein 

Patrick Gonzales 
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Listing of NCES Working Papers by Subject 



No. Title 



NCES contact 



Achievement (student) - mathematics 

2001-05 Using TIMSS to Analyze Correlates of Performance Variation in Mathematics 

Adult education 

96-14 The 1995 National Household Education Survey: Reinterview Results for the Adult 
Education Component 

96-20 1991 National Household Education Survey (NHES:91) Questionnaires: Screener, Early 

Childhood Education, and Adult Education 

96-22 1995 National Household Education Survey (NHES:95) Questionnaires: Screener, Early 

Childhood Program Participation, and Adult Education 

98-03 Adult Education in the 1990s: A Report on the 1991 National Household Education 
Survey 

98-10 Adult Education Participation Decisions and Barriers: Review of Conceptual Frameworks 
and Empirical Studies 

1999-1 1 Data Sources on Lifelong Learning Available from the National Center for Education 
Statistics 

2000-1 6a Lifelong Learning NCES Task Force: Final Report Volume I 

2000-1 6b Lifelong Learning NCES Task Force: Final Report Volume II 

Adult literacy — see Literacy of adults 



American Indian - education 

1999-13 1993-94 Schools and Staffing Survey: Data File User’s Manual, Volume IV: Bureau of 

Indian Affairs (BIA) Restricted-Use Codebook 



Assessment/achievement 
95-12 Rural Education Data User’s Guide 

95-13 Assessing Students with Disabilities and Limited English Proficiency 
97-29 Can State Assessment Data be Used to Reduce State NAEP Sample Sizes? 

97-30 ACT’s NAEP Redesign Project: Assessment Design is the Key to Useful and Stable 
Assessment Results 

97-3 1 NAEP Reconfigured: An Integrated Redesign of the National Assessment of Educational 
Progress 

97-32 Innovative Solutions to Intractable Large Scale Assessment (Problem 2: Background 
Questions) 

97- 37 Optimal Rating Procedures and Methodology for NAEP Open-ended Items 

97^14 Development of a SASS 1993-94 School-Level Student Achievement Subfile: Using 
State Assessments and State NAEP, Feasibility Study 

98- 09 High School Curriculum Structure: Effects on Coursetaking and Achievement in 

Mathematics for High School Graduates — An Examination of Data from the National 
Education Longitudinal Study of 1988 

2001-07 A Comparison of the National Assessment of Educational Progress (NAEP), the Third 

International Mathematics and Science Study Repeat (TIMSS-R), and the Programme 
for International Student Assessment (PISA) 

2001-1 1 Impact of Selected Background Variables on Students’ NAEP Math Performance 
200 1-1 3 The Effects of Accommodations on the Assessment of LEP Students in NAEP 
2001-19 The Measurement of Home Background Indicators: Cognitive Laboratory Investigations 
of the Responses of Fourth and Eighth Graders to Questionnaire Items and Parental 
Assessment of the Invasiveness of These Items 



Beginning students in postsecondary education 

98-1 1 Beginning Postsecondary Students Longitudinal Study First Follow-up (BPS:96-98) Field 
Test Report 

2001-04 Beginning Postsecondary Students Longitudinal Study: 1996-2001 (BPS: 1996/2001) 

Field Test Methodology Report 



Patrick Gonzales 

Steven Kaufman 

Kathryn Chandler 

Kathryn Chandler 

Peter Stowe 

Peter Stowe 

Lisa Hudson 

Lisa Hudson 
Lisa Hudson 



Kerry Gruber 



Samuel Peng 
James Houser 
Larry Ogle 
Larry Ogle 

Larry Ogle 

Larry Ogle 

Larry Ogle 
Michael Ross 

Jeffrey Owings 



Arnold Goldstein 

Arnold Goldstein 
Arnold Goldstein 
Arnold Goldstein 

Aurora D’Amico 
Paula Knepper 
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No. 



Title 



NCES contact 



Civic participation 

97-25 1996 National Household Education Survey (NHES:96) Questionnaires: 

Screener/Household and Library, Parent and Family Involvement in Education and 
Civic Involvement, Youth Civic Involvement, and Adult Civic Involvement 

Climate of schools 

95-14 Empirical Evaluation of Social, Psychological, & Educational Construct Variables Used 
in NCES Surveys 

Cost of education indices 

94-D5 Cost-of-Education Differentials Across the States 



Course-taking 



95-12 

98-09 



1999-05 

1999-06 



Rural Education Data User’s Guide 

High School Curriculum Structure: Effects on Coursetaking and Achievement in 

Mathematics for High School Graduates — An Examination of Data from the National 
Education Longitudinal Study of 1988 
Procedures Guide for Transcript Studies 
1998 Revision of the Secondary School Taxonomy 



Crime 

97-09 



Status of Data on Crime and Violence in Schools: Final Report 



Curriculum 

95-1 1 Measuring Instruction, Curriculum Content, and Instructional Resources: The Status of 
Recent Work 

98-09 High School Curriculum Structure: Effects on Coursetaking and Achievement in 

Mathematics for High School Graduates — An Examination of Data from the National 
Education Longitudinal Study of 1988 



Customer 

1999- 10 

2000 - 02 

2000- 04 

2001 - 12 



service 

What Users Say About Schools and Staffing Survey Publications 
Coordinating NCES Surveys: Options, Issues, Challenges, and Next Steps 
Selected Papers on Education Surveys: Papers Presented at the 1998 and 1999 ASA and 
1999 AAPOR Meetings 

Customer Feedback on the 1990 Census Mapping Project 



Data quality 

97-13 

2001-11 

2001-13 

2001-19 



Improving Data Quality in NCES: Database-to-Report Process 
Impact of Selected Background Variables on Students’ NAEP Math Performance 
The Effects of Accommodations on the Assessment of LEP Students in NAEP 
The Measurement of Home Background Indicators: Cognitive Laboratory Investigations 
of the Responses of Fourth and Eighth Graders to Questionnaire Items and Parental 



Assessment of the Invasiveness of These Items 



Data warehouse 

2000-04 Selected Papers on Education Surveys: Papers Presented at the 1998 and 1999 ASA and 
1999 AAPOR Meetings 



Design effects 

2000-03 Strengths and Limitations of Using SUDAAN, Stata, and WesVarPC for Computing 
Variances from NCES Data Sets 

Dropout rates, high school 

95- 07 National Education Longitudinal Study of 1988: Conducting Trend Analyses HS&B and 

NELS:88 Sophomore Cohort Dropouts 

Early childhood education 

96- 20 1991 National Household Education Survey (NHES:91) Questionnaires: Screener, Early 

Childhood Education, and Adult Education 



Kathryn Chandler 



Samuel Peng 



William J. Fowler, Jr. 



Samuel Peng 
Jeffrey Owings 



Dawn Nelson 
Dawn Nelson 



Lee Hoffman 



Sharon Bobbitt & 
John Ralph 
Jeffrey Owings 



Dan Kasprzyk 
Valena Plisko 
Dan Kasprzyk 

Dan Kasprzyk 



Susan Ahmed 
Arnold Goldstein 
Arnold Goldstein 
Arnold Goldstein 



Dan Kasprzyk 



Ralph Lee 



Jeffrey Owings 



Kathryn Chandler 
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No. Title 

96- 22 1995 National Household Education Survey (NHES:95) Questionnaires: Screener, Early 

Childhood Program Participation, and Adult Education 

97- 24 Formulating a Design for the ECLS: A Review of Longitudinal Studies 

97- 36 Measuring the Quality of Program Environments in Head Start and Other Early Childhood 

Programs: A Review and Recommendations for Future Research 

1999- 01 A Birth Cohort Study: Conceptual and Design Considerations and Rationale 

2001-02 Measuring Father Involvement in Young Children's Lives: Recommendations for a 

Fatherhood Module for the ECLS-B 

2001-03 Measures of Socio-Emotional Development in Middle School 

2001-06 Papers from the Early Childhood Longitudinal Studies Program: Presented at the 2001 
AERA and SRCD Meetings 

Educational attainment 

98- 1 1 Beginning Postsecondary Students Longitudinal Study First Follow-up (BPS: 96-98) Field 

Test Report 

2001- 15 Baccalaureate and Beyond Longitudinal Study: 2000/01 Follow-Up Field Test 

Methodology Report 

Educational research 

2000- 02 Coordinating NCES Surveys: Options, Issues, Challenges, and Next Steps 

2002- 01 Legal and Ethical Issues in the Use of Video in Education Research 

Eighth-graders 

2001- 05 Using TIMSS to Analyze Correlates of Performance Variation in Mathematics 

Employment 

96-03 National Education Longitudinal Study of 1988 (NELS:88) Research Framework and 
Issues 

98-1 1 Beginning Postsecondary Students Longitudinal Study First Follow-up (BPS:96-98) Field 
Test Report 

2000-1 6a Lifelong Learning NCES Task Force: Final Report Volume I 

2000- 1 6b Lifelong Learning NCES Task Force: Final Report Volume II 

2001- 01 Cross-National Variation in Educational Preparation for Adulthood: From Early 

Adolescence to Young Adulthood 

Employment — after college 

2001-15 Baccalaureate and Beyond Longitudinal Study: 2000/01 Follow-Up Field Test 
Methodology Report 



Engineering 

2000- 1 1 Financial Aid Profile of Graduate Students in Science and Engineering 

Enrollment — after college 

2001- 15 Baccalaureate and Beyond Longitudinal Study: 2000/01 Follow-Up Field Test 

Methodology Report 

Faculty - higher education 

97-26 Strategies for Improving Accuracy of Postsecondary Faculty Lists 

2000- 01 1999 National Study of Postsecondary Faculty (NSOPF:99) Field Test Report 

Fathers - role in education 

2001- 02 Measuring Father Involvement in Young Children's Lives: Recommendations for a 

Fatherhood Module for the ECLS-B 



Finance - elementary and secondary schools 
94-05 Cost-of-Education Differentials Across the States 
96-19 Assessment and Analysis of School-Level Expenditures 
98-01 Collection of Public School Expenditure Data: Development of a Questionnaire 

1999-07 Collection of Resource and Expenditure Data on the Schools and Staffing Survey 

1999-16 Measuring Resources in Education: From Accounting to the Resource Cost Model 
Approach 
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NCES contact 
Kathryn Chandler 

Jerry West 
Jerry West 

Jerry West 
Jerry West 

Elvira Hausken 
Jerry West 



Aurora D’Amico 
Andrew G. Malizio 



Valena Plisko 
Patrick Gonzales 



Patrick Gonzales 



Jeffrey Owings 

Aurora D’Amico 

Lisa Hudson 
Lisa Hudson 
Elvira Hausken 



Andrew G. Malizio 



Aurora D’Amico 



Andrew G. Malizio 



Linda Zimbler 
Linda Zimbler 



Jerry West 



William J. Fowler, Jr. 
William J. Fowler, Jr. 
Stephen Broughman 
Stephen Broughman 
William J. Fowler, Jr. 



No. Title 

2000- 18 Feasibility Report: School-Level Finance Pretest, Public School District Questionnaire 

2001- 14 Evaluation of the Common Core of Data (CCD) Finance Data Imputations 



Finance - postsecondary 
97-27 Pilot Test of IPEDS Finance Survey 

2000-14 IPEDS Finance Data Comparisons Under the 1997 Financial Accounting Standards for 
Private, Not-for-Profit Institutes: A Concept Paper 



Finance - 

95- 17 

96- 16 

97- 07 

97-22 

1999- 07 

2000- 15 



private schools 

Estimates of Expenditures for Private K-12 Schools 
Strategies for Collecting Finance Data from Private Schools 
The Determinants of Per-Pupil Expenditures in Private Elementary and Secondary 
Schools: An Exploratory Analysis 

Collection of Private School Finance Data: Development of a Questionnaire 
Collection of Resource and Expenditure Data on the Schools and Staffing Survey 
Feasibility Report: School-Level Finance Pretest, Private School Questionnaire 



Geography 

98-04 Geographic Variations in Public Schools’ Costs 



Graduate students 

2000-1 1 Financial Aid Profile of Graduate Students in Science and Engineering 



Graduates of postsecondary education 

2001-15 Baccalaureate and Beyond Longitudinal Study: 2000/01 Follow-Up Field Test 
Methodology Report 



Imputation 

2000- 04 Selected Papers on Education Surveys: Papers Presented at the 1998 and 1999 ASA and 

1999 AAPOR Meeting 

2001- 10 Comparison of Proc Impute and Schafer’s Multiple Imputation Software 

2001-14 Evaluation of the Common Core of Data (CCD) Finance Data Imputations 
2001-16 Imputation of Test Scores in the National Education Longitudinal Study of 1988 

2001-17 A Study of Imputation Algorithms 

2001-18 A Study of Variance Estimation Methods 

Inflation 

97-43 Measuring Inflation in Public School Costs 

Institution data 

2000-01 1999 National Study of Postsecondary Faculty (NSOPF:99) Field Test Report 



Instructional resources and practices 

95-1 1 Measuring Instruction, Curriculum Content, and Instructional Resources: The Status of 
Recent Work 

1999-08 Measuring Classroom Instructional Processes: Using Survey and Case Study Field Test 
Results to Improve Item Construction 



International comparisons 

97-1 1 International Comparisons of Inservice Professional Development 
97-16 International Education Expenditure Comparability Study: Final Report, Volume I 

97-17 International Education Expenditure Comparability Study: Final Report, Volume II, 

Quantitative Analysis of Expenditure Comparability 
2001-01 Cross-National Variation in Educational Preparation for Adulthood: From Early 
Adolescence to Young Adulthood 

2001-07 A Comparison of the National Assessment of Educational Progress (NAEP), the Third 

International Mathematics and Science Study Repeat (TIMSS-R), and the Programme 
for International Student Assessment (PISA) 



International comparisons - math and science achievement 

2001-05 Using TIMSS to Analyze Correlates of Performance Variation in Mathematics 



NCES contact 

Stephen Broughman 
Frank Johnson 



Peter Stowe 
Peter Stowe 



Stephen Broughman 
Stephen Broughman 
Stephen Broughman 

Stephen Broughman 
Stephen Broughman 
Stephen Broughman 



William J. Fowler, Jr. 



Aurora D’Amico 



Andrew G. Malizio 



Dan Kasprzyk 

Sam Peng 
Frank Johnson 
Ralph Lee 
Ralph Lee 
Ralph Lee 



William J. Fowler, Jr. 



Linda Zimbler 



Sharon Bobbitt & 
John Ralph 
Dan Kasprzyk 



Dan Kasprzyk 
Shelley Bums 
Shelley Bums 

Elvira Hausken 

Arnold Goldstein 



Patrick Gonzales 
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No. 



Title 



NCES contact 



Libraries 

94-07 Data Comparability and Public Policy: New Interest in Public Library Data Papers 
Presented at Meetings of the American Statistical Association 
97-25 1996 National Household Education Survey (NHES:96) Questionnaires: 

Screener/Household and Library, Parent and Family Involvement in Education and 
Civic Involvement, Youth Civic Involvement, and Adult Civic Involvement 



Carrol Kindel 
Kathryn Chandler 



Limited English Proficiency 

95-1 3 Assessing Students with Disabilities and Limited English Proficiency 
2001-1 1 Impact of Selected Background Variables on Students’ NAEP Math Performance 
2001-13 The Effects of Accommodations on the Assessment of LEP Students in NAEP 



James Houser 
Arnold Goldstein 
Arnold Goldstein 



Literacy of adults 

98-1 7 Developing the National Assessment of Adult Literacy: Recommendations from 
Stakeholders 

1999-09a 1992 National Adult Literacy Survey: An Overview 

1999-09b 1992 National Adult Literacy Survey: Sample Design 

1999-09c 1992 National Adult Literacy Survey: Weighting and Population Estimates 

1999-09d 1992 National Adult Literacy Survey: Development of the Survey Instruments 

1999-09e 1992 National Adult Literacy Survey: Scaling and Proficiency Estimates 

1999-09f 1992 National Adult Literacy Survey: Interpreting the Adult Literacy Scales and Literacy 

Levels 

1999-09g 1992 National Adult Literacy Survey: Literacy Levels and the Response Probability 

Convention 

1999- 1 1 Data Sources on Lifelong Learning Available from the National Center for Education 

Statistics 

2000- 05 Secondary Statistical Modeling With the National Assessment of Adult Literacy: 

Implications for the Design of the Background Questionnaire 
2000-06 Using Telephone and Mail Surveys as a Supplement or Alternative to Door-to-Door 
Surveys in the Assessment of Adult Literacy 

2000-07 “How Much Literacy is Enough?” Issues in Defining and Reporting Performance 
Standards for the National Assessment of Adult Literacy 
2000-08 Evaluation of the 1992 NALS Background Survey Questionnaire: An Analysis of Uses 

with Recommendations for Revisions 

2000- 09 Demographic Changes and Literacy Development in a Decade 

2001- 08 Assessing the Lexile Framework: Results of a Panel Meeting 



Sheida White 

Alex Sedlacek 
Alex Sedlacek 
Alex Sedlacek 
Alex Sedlacek 
Alex Sedlacek 
Alex Sedlacek 

Alex Sedlacek 

Lisa Hudson 

Sheida White 

Sheida White 

Sheida White 

Sheida White 

Sheida White 
Sheida White 



Literacy of adults - international 

97-33 Adult Literacy: An International Perspective 



Marilyn Binkley 



Mathematics 

98-09 

1999-08 

2001-05 

2001-07 

2001-11 



High School Curriculum Structure: Effects on Coursetaking and Achievement in 

Mathematics for High School Graduates — An Examination of Data from the National 
Education Longitudinal Study of 1988 

Measuring Classroom Instructional Processes: Using Survey and Case Study Field Test 
Results to Improve Item Construction 

Using TIMSS to Analyze Correlates of Performance Variation in Mathematics 
A Comparison of the National Assessment of Educational Progress (NAEP), the Third 
International Mathematics and Science Study Repeat (TIMSS-R), and the Programme 
for International Student Assessment (PISA) 

Impact of Selected Background Variables on Students’ NAEP Math Performance 



Jeffrey Owings 

Dan Kasprzyk 

Patrick Gonzales 
Arnold Goldstein 

Arnold Goldstein 



Parental involvement in education 

96- 03 National Education Longitudinal Study of 1988 (NELS:88) Research Framework and 

Issues 

97- 25 1996 National Household Education Survey (NHES:96) Questionnaires: 

Screener/Household and Library, Parent and Family Involvement in Education and 
Civic Involvement, Youth Civic Involvement, and Adult Civic Involvement 
1999-01 A Birth Cohort Study: Conceptual and Design Considerations and Rationale 



Jeffrey Owings 
Kathryn Chandler 



Jerry West 
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No, Title 

2001-06 Papers from the Early Childhood Longitudinal Studies Program: Presented at the 2001 
AERA and SRCD Meetings 

2001- 19 The Measurement of Home Background Indicators: Cognitive Laboratory Investigations 

of the Responses of Fourth and Eighth Graders to Questionnaire Items and Parental 
Assessment of the Invasiveness of These Items 

Participation rates 

98-10 Adult Education Participation Decisions and Barriers: Review of Conceptual Frameworks 
and Empirical Studies 

Postsecondary education 

1999- 1 1 Data Sources on Lifelong Learning Available from the National Center for Education 

Statistics 

2000- 16a Lifelong Learning NCES Task Force: Final Report Volume I 

2000-1 6b Lifelong Learning NCES Task Force: Final Report Volume II 

Postsecondary education - persistence and attainment 

98-1 1 Beginning Postsecondary Students Longitudinal Study First Follow-up (BPS:96-98) Field 
Test Report 

1999- 15 Projected Postsecondary Outcomes of 1992 High School Graduates 

Postsecondary education - staff 

97-26 Strategies for Improving Accuracy of Postsecondary Faculty Lists 

2000- 01 1999 National Study of Postsecondary Faculty (NSOPF:99) Field Test Report 

Principals 

2000-10 A Research Agenda for the 1999-2000 Schools and Staffing Survey 
Private schools 

96- 16 Strategies for Collecting Finance Data from Private Schools 

97- 07 The Determinants of Per-Pupil Expenditures in Private Elementary and Secondary 

Schools: An Exploratory Analysis 

97-22 Collection of Private School Finance Data: Development of a Questionnaire 
2000-13 Non-professional Staff in the Schools and Staffing Survey (SASS) and Common Core of 
Data (CCD) 

2000-15 Feasibility Report: School-Level Finance Pretest, Private School Questionnaire 
Projections of education statistics 

1999-15 Projected Postsecondary Outcomes of 1992 High School Graduates 
Public school finance 

1999- 16 Measuring Resources in Education: From Accounting to the Resource Cost Model 

Approach 

2000- 18 Feasibility Report: School-Level Finance Pretest, Public School District Questionnaire 

Public schools 

97— 43 Measuring Inflation in Public School Costs 

98- 01 Collection of Public School Expenditure Data: Development of a Questionnaire 

98-04 Geographic Variations in Public Schools’ Costs 

1999- 02 Tracking Secondary Use of the Schools and Staffing Survey Data: Preliminary Results 

2000- 12 Coverage Evaluation of the 1994-95 Public Elementary/Secondary School Universe 

Survey 

2000-13 Non-professional Staff in the Schools and Staffing Survey (SASS) and Common Core of 
Data (CCD) 

2002- 02 Locale Codes 1987 - 2000 



NCES contact 
Jerry West 

Arnold Goldstein 



Peter Stowe 



Lisa Hudson 

Lisa Hudson 
Lisa Hudson 

Aurora D’Amico 
Aurora D’Amico 



Linda Zimbler 
Linda Zimbler 



Dan Kasprzyk 



Stephen Broughman 
Stephen Broughman 

Stephen Broughman 
Kerry Gruber 

Stephen Broughman 



Aurora D’Amico 



William J. Fowler, Jr. 
Stephen Broughman 



William J. Fowler, Jr. 
Stephen Broughman 
William J. Fowler, Jr. 
Dan Kasprzyk 
Beth Young 

Kerry Gruber 

Frank Johnson 
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No. 



Title 



NCES contact 



Public schools- secondary 

98-09 High School Curriculum Structure: Effects on Coursetaking and Achievement in 

Mathematics for High School Graduates — An Examination of Data from the National 
Education Longitudinal Study of 1988 



Reform, educational 

96-03 National Education Longitudinal Study of 1988 (NELS:88) Research Framework and 
Issues 



Response rates 

98-02 Response Variance in the 1993-94 Schools and Staffing Survey: A Reinterview Report 
School districts 

2000-10 A Research Agenda for the 1999-2000 Schools and Staffing Survey 

School districts, public 

98-07 Decennial Census School District Project Planning Report 

1999-03 Evaluation of the 1996-97 Nonfiscal Common Core of Data Surveys Data Collection, 
Processing, and Editing Cycle 

School districts, public - demographics of 

96- 04 Census Mapping Project/School District Data Book 

Schools 

97 - 42 Improving the Measurement of Staffing Resources at the School Level: The Development 

of Recommendations for NCES for the Schools and Staffing Survey (SASS) 

98- 08 The Redesign of the Schools and Staffing Survey for 1999-2000: A Position Paper 

1999- 03 Evaluation of the 1996-97 Nonfiscal Common Core of Data Surveys Data Collection, 

Processing, and Editing Cycle 

2000- 10 A Research Agenda for the 1999-2000 Schools and Staffing Survey 

2002-02 Locale Codes 1987 - 2000 

Schools - safety and discipline 

97-09 Status of Data on Crime and Violence in Schools: Final Report 
Science 

2000- 1 1 Financial Aid Profile of Graduate Students in Science and Engineering 

2001- 07 A Comparison of the National Assessment of Educational Progress (N AEP), the Third 

International Mathematics and Science Study Repeat (T1MSS-R), and the Programme 
for International Student Assessment (PISA) 

Software evaluation 

2000-03 Strengths and Limitations of Using SUDAAN, Stata, and WesVarPC for Computing 
Variances from NCES Data Sets 

Staff 

97 — 42 Improving the Measurement of Staffing Resources at the School Level: The Development 

of Recommendations for NCES for the Schools and Staffing Survey (SASS) 

98- 08 The Redesign of the Schools and Staffing Survey for 1999-2000: A Position Paper 

Staff- higher education institutions 

97-26 Strategies for Improving Accuracy of Postsecondary Faculty Lists 

Staff — nonprofessional 

2000-13 Non-professional Staff in the Schools and Staffing Survey (SASS) and Common Core of 
Data (CCD) 

State 

1999-03 Evaluation of the 1996-97 Nonfiscal Common Core of Data Surveys Data Collection, 
Processing, and Editing Cycle 



Jeffrey Owings 



Jeffrey Owings 



Steven Kaufman 



Dan Kasprzyk 



Tai Phan 
Beth Young 



Tai Phan 



Mary Rollefson 

Dan Kasprzyk 
Beth Young 

Dan Kasprzyk 
Frank Johnson 



Lee Hoffman 



Aurora D’Amico 
Arnold Goldstein 



Ralph Lee 



Mary Rollefson 
Dan Kasprzyk 



Linda Zimbler 



Kerry Gruber 



Beth Young 



No. 



Title 



NCES contact 



Statistical methodology 

97-21 Statistics for Policymakers or Everything You Wanted to Know About Statistics But 
Thought You Could Never Understand 



Statistical standards and methodology 

2001-05 Using TIMSS to Analyze Correlates of Performance Variation in Mathematics 

Students with disabilities 

95-13 Assessing Students with Disabilities and Limited English Proficiency 
2001-13 The Effects of Accommodations on the Assessment of LEP Students in NAEP 



Susan Ahmed 



Patrick Gonzales 



James Houser 
Arnold Goldstein 



Survey methodology 

96- 17 National Postsecondary Student Aid Study: 1996 Field Test Methodology Report 

97- 15 Customer Service Survey: Common Core of Data Coordinators 

97- 35 Design, Data Collection, Interview Administration Time, and Data Editing in the 1996 

National Household Education Survey 

98- 06 National Education Longitudinal Study of 1988 (NELS:88) Base Year through Second 

Follow-Up: Final Methodology Report 

98-1 1 Beginning Postsecondary Students Longitudinal Study First Follow-up (BPS:96-98) Field 
Test Report 

98-16 A Feasibility Study of Longitudinal Design for Schools and Staffing Survey 
1999-07 Collection of Resource and Expenditure Data on the Schools and Staffing Survey 

1999- 17 Secondary Use of the Schools and Staffing Survey Data 

2000- 01 1999 National Study of Postsecondary Faculty (NSOPF:99) Field Test Report 

2000-02 Coordinating NCES Surveys: Options, Issues, Challenges, and Next Steps 

2000-04 Selected Papers on Education Surveys: Papers Presented at the 1998 and 1999 ASA and 

1999 AAPOR Meetings 

2000-12 Coverage Evaluation of the 1994-95 Public Elementary /Secondary School Universe 
Survey 

2000- 17 National Postsecondary Student Aid Study :2000 Field Test Methodology Report 

2001- 04 Beginning Postsecondary Students Longitudinal Study: 1996-2001 (BPS: 1996/2001) 

Field Test Methodology Report 

2001-07 A Comparison of the National Assessment of Educational Progress (NAEP), the Third 

International Mathematics and Science Study Repeat (TIMSS-R), and the Programme 
for International Student Assessment (PISA) 

2001-09 An Assessment of the Accuracy of CCD Data: A Comparison of 1988, 1989, and 1990 
CCD Data with 1990-91 SASS Data 

2001-1 1 Impact of Selected Background Variables on Students’ NAEP Math Performance 
2001-13 The Effects of Accommodations on the Assessment of LEP Students in NAEP 

2001- 19 The Measurement of Home Background Indicators: Cognitive Laboratory Investigations 

of the Responses of Fourth and Eighth Graders to Questionnaire Items and Parental 
Assessment of the Invasiveness of These Items 

2002- 01 Legal and Ethical Issues in the Use of Video in Education Research 

2002-02 Locale Codes 1987 - 2000 

2002-03 National Postsecondary Student Aid Study, 1999-2000 (NPSAS:2000), CATI 
Nonresponse Bias Analysis Report. 



Andrew G. Malizio 
Lee Hoffman 
Kathryn Chandler 

Ralph Lee 

Aurora D’Amico 

Stephen Broughman 
Stephen Broughman 
Susan Wiley 
Linda Zimbler 
Valena Plisko 
Dan Kasprzyk 

Beth Young 

Andrew G. Malizio 
Paula Knepper 

Arnold Goldstein 



John Sietsema 

Arnold Goldstein 
Arnold Goldstein 
Arnold Goldstein 



Patrick Gonzales 
Frank Johnson 
Andrew Malizio 



Teachers 



98-13 


Response Variance in the 1994-95 Teacher Follow-up Survey 


Steven Kaufman 


1999-14 


1994-95 Teacher Followup Survey: Data File User’s Manual, Restricted-Use Codebook 


Kerry Gruber 


2000-10 


A Research Agenda for the 1999-2000 Schools and Staffing Survey 


Dan Kasprzyk 


Teachers - 


instructional practices of 




98-08 


The Redesign of the Schools and Staffing Survey for 1999-2000: A Position Paper 


Dan Kasprzyk 


Teachers - 


opinions regarding safety 




98-08 


The Redesign of the Schools and Staffing Survey for 1999-2000: A Position Paper 


Dan Kasprzyk 


Teachers - 


performance evaluations 




1999-04 


Measuring Teacher Qualifications 


Dan Kasprzyk 
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No. 



Title 



NCES contact 



Teachers - qualifications of 

1999-04 Measuring Teacher Qualifications Dan Kasprzyk 

Teachers - salaries of 

94-05 Cost-of-Education Differentials Across the States William J. Fowler, Jr. 

Training 

2000-1 6a Lifelong Learning NCES Task Force: Final Report Volume I 

2000-1 6b Lifelong Learning NCES Task Force: Final Report Volume II 



Lisa Hudson 
Lisa Hudson 



Variance estimation 

2000-03 Strengths and Limitations of Using SUDAAN, Stata, and WesVarPC for Computing Ralph Lee 

Variances from NCES Data Sets 

2000- 04 Selected Papers on Education Surveys: Papers Presented at the 1998 and 1999 ASA and Dan Kasprzyk 

1999 AAPOR Meetings 

2001- 18 A Study of Variance Estimation Methods Ralph Lee 

Violence 

97-09 Status of Data on Crime and Violence in Schools: Final Report Lee Hoffman 



Vocational education 

95-12 Rural Education Data User’s Guide 
1999-05 Procedures Guide for Transcript Studies 
1999-06 1998 Revision of the Secondary School Taxonomy 



Samuel Peng 
Dawn Nelson 
Dawn Nelson 
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